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When we have a continuous outcome e.g., bonding strength and two categorical 
explanatory variables such as 4 different resin types and 2 different curing light 
sources, usually we consider applying the two-way ANOVA for analyzing the 
relationships. However because implementing the two-way ANOVA is relatively 
complicated, some clinical researchers prefer to apply the one-way ANOVA for one 
factor on each level of the other factor, repeatedly. They often insist that they are 
interested only in one factor (e.g., manipulation methods) and are not interested 
in the other factor (e.g., brands), claiming that the one-way ANOVA is the more 
appropriate strategy. Even though the trial with a variety of brands may be considered 
as a simple way of generalization among various brand types, possible different effects 
of materials of different brands can never be detected by the one-way ANOVA. Actually 
materials of different brands may have slightly different ingredient compositions which 
may elicit different effects on the other factor. Application of the one-way ANOVA 
cannot detect the possible interaction between two explanatory categories. 

Table 1 shows a data of bonding strength of four types of resin (A, B, C and D) on the 
teeth surface with a simultaneous use of two different curing light sources (Halogen, 
LED). The highest overall bonding strength is found on resin D followed by resin C and 
resin B showing insignificant differences (see the superscript a, b, and c). Considering 
cases using the 'Halogen,' resin D is the strongest among four resin types, while resin 
C shows the highest value when the 'LED' was used. This explicitly shows that the 
effects of different resin types are not following a similar trend according to different 
levels of curing methods, 'Halogen' or 'LED'. Figure la shows that trend of (descriptive) 
mean bonding strengths for resin types are changing according to the levels of curing 
methods. 

Interaction model or main effect (no-interaction) model? 

When we have a quantitative continuous outcome and two categorical explanatory 
variables, we may consider two kinds of relationship between two categorical variables, 
which could be typically seen in the Figures lb and Ic. The Figure Ic shows that the 
relative effect of each level in the material category doesn't change with different 
levels of curing methods, which means an additive relationship between the two 
categorical variables, i.e. the second categorical variable takes a role of adding a 
uniform effect on the relationship between the outcome and the first categorical 
variable. In this relationship we can distinguish effect of one factor from that of the 
other factor. This type of model is called a main effect model or no-interaction 
model. However, Figure lb shows that the effect of material depends on the levels of 
the curing methods and we cannot tell effect of one factor separately, i.e. which light 
source does produce stronger bonding? This is called an interaction model because 
an interaction relationship is included. We may see that the interaction model could 
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Table 1. Measurements of bonding strength (Mpa) according to four different types of resin and two curing methods 



Curing Lights 


A 


B 


Resin types 
C 


D 


Mean ± SD 


Hal nnpn 


14.5, 15.2, 17.4, 
17.5, 19.2, 19.7, 
20.1, 21.3, 23.5, 
9.3 


11.8, 13.3, 19.2, 
21.3, 22.2, 23.0, 
24.5, 24.6, 27.1, 
12 


14.5, 15.0, 18.6, 

19.6, 21.0, 21.6, 
25.5, 25.9, 30.7, 
33 


35.5, 35.7, 36.3, 
37.3, 39.9, 40.9, 
41.0, 44.5, 44.7, 
47.2 




Mean ± SD 


17. o ± 4.0 


ly.y ± D.o 




40. i ± 4.^^^ 


db.l ± 10. i 


LED 


27.1, 11.6, 12.2, 
15.9, 17.0, 17.2, 
18.4, 19.8, 23.4, 
28 


27.8, 12.8, 16.2, 
19.8, 22.4, 23.6, 
25.3, 27.9, 34.6, 
35.2 


16.5, 22.7, 24.2, 
26.2, 28.4, 28.5, 
30.7, 32.2, 33.8, 
34.5 


17.3, 19.2, 19.5, 
20.5, 20.7, 22.2, 
25.8, 29.0, 29.2, 
35.1 




Mean ± SD 


19.1 ± 5.6^^ 


24.6 ± 7.3^^' 


27.8 ± 5.6' 


23.9 ± 5.7^^' 


23.8 ± 6.6 


Total Mean ± SD 


18.4 ± 4.8' 


22.2 ± 6.8'^ 


25.1 ± 6.3^ 


32.1 ± 9.7' 


24.5 + 8.6 



* Different alphabets mean significantly different values at a type one error rate of 0.05. 
By the independent t-test: p-value (Halogen vs. LED) = 0.498. 

By the One-way ANOVA (A vs. B vs. C vs. D): p-value (all methods) < 0.001, p-value (only Halogen) < 0.001, p-value (only LED) 
= 0.025. 




Figure 1. Graphs for bonding strength by resin materials (A, B, C, and D) displayed as separated lines of different curing 
light sources (Halogen & LED): (a) Descriptive means; (b) Estimated means by the model with the interaction term; (c) 
Estimated means by the model without the interaction term between two factors. 



easily reproduce the actual relationship among descriptive means, as seen in Figure la. Therefore generally the first step 
in application of the two-way ANOVA is fitting the interaction model, specified as the "Full factorial moder ( Part A , d-1, 
below) and test the significance of the interaction term. The resulting ANOVA table of two-way ANOVA interaction model 
is shown in Table 2 and g-1 (below) and we could find the interaction term (Light*Resin) is statistically significant at an 
alpha level of 0.05 (p < 0.001). As an effect of a level of one variable depends on levels of the other variable, we cannot 
separate the effects of two variables, neither independent effect of resin types nor independent effect of curing light. The 
levels of two categorical variables should combined into a total of eight categories (2 levels of Light * 4 levels of Resin) 
and the post-hoc multiple comparisons may be implemented among the eight categories as if they consist of one (combined) 
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Table 2. The ANOVA table from the two-way ANOVA considering two factors with the interaction term (correct) 



Source 


Sum of squares 


df 


Mean square F 


p-value 


Corrected model 


3602.1 


7 


514.6 16.4 


< 0.001 


Light 


34.7 


1 


34.7 1.1 


0.297 


Resin 


1997.0 


3 


665.7 21.2 


< 0.001 


Light* Resin 


1570.4 


3 


523.5 16.7 


< 0.001 


Error 


2261.6 


72 


31.4 




Corrected total 


5863.7 


79 






Table 3. Comparative mean bonding strength under the two-way ANOVA model with the interaction model (correct, g-1) 


Curing Light 


A 




Resin type. Mean ± SD 
B C 


D 


Halogen 


17.8 + 4.0'* 




19.9 ± 5.6'^ 22.5 ± 6.2'^' 


40.3 + 4.2^ 


LED 


19.1 ± 5.6"^ 




24.6 ± 7.3^' 27.8 ± 5.6' 


23.9 ± 5.7^' 


* Different alphabets mean significantly different values at a type one error rate of 0.05. 

p-value (model) < 0.001; p-value (light) = 0.297; p-value (resin) < 0.001; p-value (resin*light) < 0.001; R-square = 0.61. 



Table 4. Comparative mean bonding strength under the two-way ANOVA using the main effect model (no-interaction model, 
incorrect^ g-2) 



Curing Light 


A 


B 


Resin type. Mean ± SD 
C 


D 


p-value (resin) 


Halogen 


17.8 + 4.0'* 


19.9 + 5.6'^ 


22.5 + 6.2^ 


40.3 + 4.2' 


0.412 


LED 


19.1 + 5.6' 


24.6 + 7.3'^ 


27.8 + 5.6^ 


23.9 + 5.7' 




p-value (light) 






< 0.001 







^ This table simply shows how to report results of the main effect model, only for the purpose of illustration. Actually the Table 3 

displays the correct results which reflect given data weU. 
* Different alphabets mean significantly different values at a type one error rate of 0.05. 
p-value (model) < 0.001; R-square = 0.35. 



factor (shown in h-1®; variable name = 'light_mat'). Table 3 provides the complete report of analyses results from the 
interaction model as well as post-hoc multiple comparisons. The plot in Figure 1 may be displayed by requesting plots {e, 
below). The underlying assumptions of the two-way ANOVA model are the same with those of the one-way ANOVA, normal 
distribution of outcomes and equal variances. The assumption of normality should be checked in an exploratory procedure 
and the assumption of equal variances may be tested as the homogeneity test for the null hypothesis of equal variances for 
all groups, as shown in the procedure/, below. 

On the other hand, if we have an insignificant interaction term, different from the results above, we consider a main effect 
(no-interaction) model as shown in Part B below, which may be actually incorrect in modeling this data. Table 4 shows the 
comprehensive results of the analyses based on the main effect model, although the model is actually inadequate because 
it doesn't fit the data welL The superscripts represent statistical differences among levels of Resin types only because the 
effect of Light was insignificant (p = 0.412). You may add superscripts of upper cases to represent statistical differences in 
the levels of the Light variable if the Light is significant. 
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The two-way ANOVA with interaction term using the SPSS statistical package (SPSS Inc., Chicago, IL, USA) as 
following procedures: 



(a) Input data 



] Strength_2way_AN0VA_1 - SPSS Data Editor 



Eile Edit yiew fiata Iransform ^alyze graphs Utilities iSfinc 



T 





light 


material | strength | 


1 




1 14.49| 


2 






15.20 




3 






17.43 




4 






17.50 




5 






19.20 




6 






laTO 




7 






2aio 




8 






21.30 




9 






23.50 




10 






9.32 




11 


2 




2?.10 




12 


2 




11.60 





(b) Analysis - General Linear Model - Univariate 



: Strength_2way_AN0VA_l SPSS Data Editoi 
Analyzp 



Eile £dit yiew Qata Iransform I 



Graphs Utilities Sfindow Help 









Refiorts ► 
Descriptive Statistics ^ 
lables ► 


f 








1 




1 


light 


m 


Compare Means ► 


T " var 


var 1 


2 






Mixed Models ► 


Multivariate,.. 




3 






Correlate ► 


Repeated Measures... 


4 






Regression ► " 




5 






Lflgiinear ► , 








6 






Classify ► 








7 






Cata Reduction ► 








8 






Scale ► 








9 






Nonparametric Tests ► 








10 






Time Series ► 








11 


2 




Survival ► 








12 


2 




Multiple Response ► 








13 


2 




Missing Value Analysis... 









(c) Write variables on the windows (d-1) interaction Model 



□ 



Dependent Variable: 

I Shear bond strength (; 



Fixed Factor(s): 


1 #> light 




Immaterial 





r-Duim lerm(s) 1 

jMain effects 



R Include intercept in model 

I Continue ~| Cancel | 



(e) Request Plot 




nateriahlight 



(f) Assess assumption: equal variances 
® Request homogeneity test 



Estimated Marginal Means 

Factor(s) and Factor Interactions: Display Means for: 




n Compare main effects 
Confidence interval adjustment: 
|LSD (none) 



Display 

F Descriptive statistics 
F Estimates of effect size 
F Observed power 
f Parameter estimates 
F Cfintrast coefficient matrix 



R? Homogeneity tests 
F Sfiread vs. level plot 
F Besidual plot 
F Lack of fit 

F General estimable function 



Significance level: |.05 



Confidence intervals are 95% 
I Continue~| Cancel 



Help I 



' Result of homogeneity test 

Levene's Test of Equality of Error Variances* 



F 


dfl 


df2 


Siq. 


.775 


7 


72 


.610 



Tests the null hypothesis that the error variance of the 
dependent variable is equal across groups. 

a. Design: lntercept+light-»-materiaklight * material 



Part A: Interaction model 



(g-1) ANOVA Table: interaction model 

Tests of Between-Subjects Effects 



Dependent Variable: Shear bond strength 



Source 


Type III Sum 
of Squares 


df 


Mean Square 


F 


Siq. 


Corrected Model 


3602.103* 


7 


514.586 


16.382 


.000 


Intercept 


47894.642 


1 


47894.642 


1524.759 


.000 


light 


34.716 


1 


34.716 


1.105 


.297 


material 


1996.998 


3 


665.666 


21.192 


.000 


light ♦ material 


1570.389 


3 


523.463 


16.665 


.000 


Error 


2261.612 


72 


31.411 






Total 


53758.357 


80 








Corrected Total 


5863.715 


79 









a. R Squared = .614 (Adjusted R Squared = .577) 
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(h-1) Post-hoc multiple comparisons: with significant interaction 
® Re-arrangement of data ® Multiple comparison 



010 Strength_2way_AN0VA - SPSS Data Editor. 



File Edit View Data Transform Analyze Graphs Utilities iJfindi 



cg|H|#l ^1 



IMlLwI^rlrdOMlim 



T 





light 


material 


strength 


light-mat 


1 






14.49 


11 


2 






1520 


11 


3 






1743 


11 


4 






17.50 


11 


5 






ia20 


11 


6 






laTO 


11 


7 






20110 


11 


8 






21.30 


11 


9 






2a60 


11 


10 






a32 


11 


11 


2 




27.10 


21 


12 


2 




11.60 


21 



One-Way ANOVA: Post Hoc Multiple Comp; 



Equal Variances Assumed 

rp 

r Bonferronl 
r SIdak 
r Scheffe 
r R-E-6-WF 

r R-E-e-wQ 



r S-N-K r Waller-Duncan 
r lukey /Type II Error Ratio: (11 

r Tukeys-b p Dunnfitl 

17 Duncan Control Categorii: [Last 3 

r Hochberg's 6T2 ^Test — 

r Sabriel |(r 2-sided C < Control C > Control 

Equal Variances Not Assumed 



r Tamhane s 12 r Dunnett's T3 T 6ame8-Howell T Dunnett's C 



Significance level: |.05 



I Continue | Cancel | Help 



Homogeneous subsets 



Homogeneous Subsets 



Shear bond strength 



ligtit-mat 


N 


Subset for 


alptia = .05 




2 


3 


4 


Halogen & A 


10 


17.7740 








LED&A 


10 


19.0600 


19.0600 






Halogen &B 


10 


19.9090 


19.9090 






Halogen & C 


10 


22.5320 


22.5320 


22.5320 




LED&D 


10 




23.8500 


23.8500 




LED&B 


10 




24.5680 


24.5680 




LED&C 


10 






27 7590 




Halogen & D 


10 








40.2920 


Sig, 




.087 


.052 


.059 


1.000 



Means for groups in homogeneous subsets are disp ayed. 
a. Uses Harmonic Mean Sample Size = 10.000. 



Part B: Main effect (no-interaction) model 



d-2) Model: Main-effect model 



Univariate: Model fx^ 



Specify Model 

c Full factorial 


Custom 


Factors & Covariates: 




Model: 


light(l-) 






material(F) 


-Build T8rm(8) , 












|Main effects 











Sum of sfluares: |Type III |7 Include intercept in model 



I Continue | Cancel [ Help | 



(g-2) ANOVA Table 



Tests of Between-Subjects Effects 



Dependent VariabI 


Shear bond strength 


Source 


Type III Sum 
of Squares 


df 


Mean Square 


F 


Siq. 


Corrected Model 

Intercept 

light 

material 

Error 

Total 

Corrected Total 


203I.714' 
47894.642 
34.716 

1996.998 

3832.001 
53758.357 

5863.715 


4 
1 
1 

3 
75 
80 
79 


507.928 
47894.642 

34.716 
665.666 

51.093 


9.941 
937.395 
.679 
13.028 


.000 
.000 
.412 
.000 



a. R Squared = .346 (Adjusted R Squared = .312) 



h-2) Post-hoc multiple comparison 
® Post-hoc multiple comparison 




TlgTir 
material 



Equal Variances Assumed 

r LSD r S-N-K 

r Bonferronl r Jukey 

r Sidak r Tukey"s-b 

IV iSshelfel r Duncan 
rR-E-6-WF 
r R-E-G-WQ 



r Waller-Duncan 

Type II Error Ratio: [T 

r Dunngtt 

i Categorjii 



iLast 3 

r Hochberg's GT2 ^Test — 

r Sabriel 2-sided C < Control C > Control 

Equal Variances Not Assumed 

r Tamhane s T2 r Dunnett s 13 F 6ame8-Howell F Dunnett's C 



(2) Homogeneous subsets 

Shear bond strength 



Scheffe' 



material 


N 


Subset 


1 


2 


3 


A 


20 


18.4170 






B 


20 


22.2385 


22.2385 




C 


20 




25.1455 




D 


20 






32.0710 


Sig. 




.420 


.649 


1.000 



Means for groups in homogeneous subsets are displayed. 

Based on Type III Sum of Squares 

The error term is Mean Square(Error) = 51.093. 

a. Uses Harmonic Mean Sample Size = 20.000. 

b. Alpha = .05. 
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